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Introduction 


We make the usual distinction between the vector of parameters and the vector of variables 
in an optimization problem. A parametric optimal design problem is considered as a system 
whose input is the vector of parameters. Corresponding to each input parameter vector, 
the output is, collectively, the feasible domain, the optimal objective value and the optimal 
variable vector. Hence, this input to output relation is characterized by a point-to-set map. 
When the stability arguments of such a map are augmented with the need to identify the 
optimal input for a given system, a very useful framework emerges for design problems. 
Recent results seem to indicate that such an approach would address the issue of studying 
the modeling of the design itself, in conjunction with the numerical procedures that are used 
to solve the optimization problem. While the concept of parametric optimization is not new, 
its interpretation in the form of an input to output mapping, and the associated solution 
strategy that could make explicit the inner stability of a problem, are considered very useful 
generalizations of traditional design optimization models (see fig. 1). 


DESIGN OPTIMIZATION PROBLEM 



Figure 1 
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Problem Statement 


The terminology used here closely follows that used in ref. 1. The general design opti- 
mization model is assumed to be stated as: 


minimize /(z,p) 


P{x y p ) subject to 


9k(x,p) < 0 


hi(x,p) = 0 

i € M = {1,.. . ,m} 

P = ( Pi ) 

e P C 

X = (z.) 

acr 


where /, gk and ft,- are the scalar objective, inequality, and equality constraint functions 
respectively. The variable vector x = (z,) usually describes the conventional design variables 
such as member areas in a truss structure. The vector p is a parameter that could describe, 
for example, the allowable yield stress for a truss member. 

For any particular p = p* € P, the model P(x,p) is the usual mathematical programming 
statement: 

minimize /(x), x € 3?” 
subject to 

h(x) = 0 < 2 > 

g(x) < 0 
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A Generalized Model as an Input-Output System 

The basic idea in input-output (10) formulations is as follows (fig. 2). We consider the 
model P(x,p ) to be a system whose input is a particular p € P. Corresponding to 
each such admissible input, the output is defined as collectively {F(p), F*(p), f m (p)} where 

F(p) = {x £ : gk(x,p) < 0 k £ L, hi(x,p ) = 0, i £ M } is the feasible set 

F*(p) = {x*(p)}, is the set of optimal solutions x* 
f*(p ) = f{x*(p),p), the optimal value function 


STRUCTURE OF AN 10 FORMULATION 


INPUT 

MATHEMATICAL MODEL 

OUTPUT 



f 



{F(p),F*(p),/*(p)} 



feedback loop to obtain 

it 



realization of the "optimal model" 


DESIRED OUTCOME FROM AN IQ FORMULATION 

• OPTIMAL REALIZATION OF THE MATHEMATICAL MODEL 

• THE BEST STABLE (AND FEASIBLE) PATH FROM THE INI- 
TIAL INPUT TO THE OPTIMAL INPUT 

Figure 2 
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IO and Conventional NLP* 

One must at the outset try to answer under what circumstances would such an input- 
output formulation be more useful than the following single problem formulation: 

minimize /( z), where z = (x, p) € 3? n+p 

subject to / o \ 

h(z) = 0 1 j 

g(») < o 

While the formulation above appeals to simplicity in its treatment since conventional op- 
timality conditions and numerical methods apply to it, there are however some issues of 
note (fig. 3): 


• THE SOLUTIONS TO THE PROBLEMS (1) and (3) MAY NOT 
COINCIDE. In some cases, a new set of necessary conditions can be derived 
for the 10 solution (ref. 1). 

• A SIMPLER (such as convex or monotonic) SUBPROBLEM can 

sometimes be derived by splitting the original variable vector 2 into a new 
variable x, of smaller dimension, and a parameter 9. Relates to decomposi- 
tion techniques used in large-scale programming. 


• Most importantly, an IO formulation, if successfully implemented, would 
CHARACTERIZE THE INNER STABILITY OF THE PROGRAM. 
The behavior of critical points on an 10 path is identified as explicit model 
specific properties and enables us to view modeling and solution techniques 
in a unified way. 


Figure 3 

^Nonlinear Programming (NLP). 
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Stability Properties in Generalized Modeling 

Following the usual notion of well-posedness, we say that a mathematical problem is 
well-posed if its solution is continuous w.r.t.* to the data. As we have seen, P(x,p) is 
an imbedded or parametrized family of mathematical programs. For these programs, the 
notion of stability is defined directly in terms of the continuity of the solution w.r.t. the 
perturbation vector p. In any study of such a perturbed family of related problems, the 
question of stability becomes central for two important reasons: Unstable points or regions 
should be identified to see if there is an attendant physical interpretation to the loss of 
stability; and if the problem is stable everywhere then standard optimality conditions would 
apply in the problem P(x) where z — ( x,p ). The continuity of parameter-dependent feasible 
sets, solution sets and extremal value functions is useful to answer many questions such as: 

• For which optimal design models, the intuitive argument that the accuracy of the so- 
lution obtained increases with the degree of approximation of the initial data, is indeed 
justified. 

• If an exact solution can be viewed as an approximation to a solution of the problems 
that correspond to small perturbations of the initial parameters. This is particularly 
important if the calculation of solution requires substantial time and expense. 

• Finally, what are the quantitative bounds on the solution as the initial data is substan- 
tially varied. 

The stability information that we refer to here is directly related to (upper and lower) 
continuity properties of certain point-set-maps. As an example of such a map, we have: 

fi : x x », fi(0) = {F(0),F*(0),f(0)} 

Several studies have been reported on the theoretical properties of such maps (e.g. ref. 2 
and ref. 3). 

Many of the ea rly results in stability of optimal value function in nonlinear programming 
were obtained foil right-hand-side perturbations of constraints (ref. 4). While studying 
general perturbations in the problem P(x,p): 

P(i,p) : min{f(x,p) : g(x,p) < 0,/i(x,p) = 0 ,(x,p) € X x P}, 

l 

an interesting observation from ref. 5 is that at least when the dependence of /, g, and h on 
p is locally Lipschitz, a problem P(*,y,p) with equal /*(p) can be formulated having only 
right-hand-side perturbations (Note that now the variable vector is (x, y)) : 

P(*»V»P) : mtn{/(x,y) : g(x,y) < 0 ,h(x,y) = 0, -y + p = 0, (x,y,p) € X x P x P) 


with respect to (w.r.t.) 
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Regularity of Constraints and Stability 

The study of constraint qualifications and nontrivial abnormality in Lagrange multiplier 
values is closely related to the study of stability of the optimal value function (ref. 5 and ref. 

6) . For example, if the second order sufficiency conditions hold at a local minimizer at which 
the constraints are regular, then that local minimizer persists under small perturbations (ref. 

7) . And the well known Mangasarian-Fromovitz constraint qualification is a necessary and 
sufficient condition for the set of Lagrange multiplier vectors associated with a stationary 
solution to form a compact polyhedron (ref. 8). While stability of optimal value function 
has been treated extensively in literature, the stability properties of the optimal solution set 
have also been considered (ref. 3 and ref. 9). From a computational standpoint, numerical 
continuation and bifurcation techniques can be applied to the critical points characterized 
by some suitable first-order necessary conditions (ref. 10 and also ref. 11). One can then 
classify the singularities based on: 

1. Loss of the strict complementarity condition (see fig. 4) 

2. Linear dependence of the gradients of the active constraints 

3. Singularity of the Hessian of the Lagrangian on the tangent space 


The solution is: 



minimize f(x,p) = z x + px 2 , x € $ 2 
subject to 

9\ + x 2 < 2 

97 ■ — *i < -1 


x* 2 =3 


p < 0 , x\ = -1, 

P = 0, x\- -1, e (— oc.3] 

p > 0, f(x,p) is unbounded 

At the singular point p = 0, there is loss of strict complementarity. 


Figure 4 
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A Design Plus Processing Model 

A common characteristic of traditional design optimization models is that they operate 
on a single hierarchical level, with the possible exception of some decomposition strategies. 
However, there still does not exist a way to properly study the modeling interactions that 
occur in such practical systems where a model structure appears not just because the overall 
system is made up of individual components or subsystems, but rather because the same 
system can be viewed from two or more viewpoints. For example, a typical structural design 
model may be developed from its functional viewpoint, and another one from a fabrication or 
processing viewpoint. Usually, to study such an integrated system, models are blended in a 
single formulation by treating many additional constants (parameters) as variables and/or by 
introducing a rather arbitrary multiobjective formulation. In these cases, it is very difficult 
to understand and represent explicitly the relation of different quantities in the solution, or 
interpret their physical meaning. It is hoped that an input- output formulation will make 
more explicit the properties of model interactions. Figure 5 below depicts a typical system 
level abstraction in a design plus processing model. 


Definition: Drawing is the process of reducing the cross- 
sectional area and/or the shape of a rod. bar. tube or wire 
(cold or hot) by pulling through a die. 



Figure: Drawing of (left) rod or wire and (right) tube 



INITIAL 
ROD DIA, 


t wEi m 


SIMPLE ANALYSIS MODEL 




SIGNIFICANT PROCESS 
VARIABLES OF WORK- 
HARDENING PROCESS 


YIELD STRENGTH 


NLP STATEMENT OF OPTIMAL 
STRUCTURAL DESIGN 


DESIGN MODEL 


OPTIMAL 

r DESIGN 

m T EUD 
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MODEL INTERACTIONS IN 10 FORMULATION 
Figure 5 




An Example of IO Formulation 


As mentioned previously, it is of considerable importance to be able to study the behavior 
of optimum design models in conjunction with some model representation (referred to here 
as the processing model) of a class of suitable fabrication processes. Detailed processing 
models are in general much harder to obtain as compared to the design models, so one is 
often left with highly simplified processing models having a very limited range of validity. A 
natural approach seems then to take the more tractable design model and treat the processing 
variables as input. One then hopes to study the extremal behavior of optimal design models 
when the input (or in generic terms the process )is perturbed in a well-defined way. Using 
a stress-strain power law as being the simplest representation of those processes where the 
material work hardens, an 10 formulation for a simple cantilever beam is described below. 
The design variables are the moments of inertia of the two segments of the stepped cantilever 
beam and the design objective is to minimize the weight of the beam subject to a deflection 
constraint at the tip load as well as a constraint on the stress at the fixed end (fig. 6). 


min 

f = l{\fx~\ + y/xl) 

(weight) 

Sub. to 



h : 

K(X) U = F 

(equilibrium) 

9i ■ 

t*3 + lu 4 — C < 0 

(deflection) 

92 ■ 

(64.0/7r) o - 25 p l/x°- 75 (K/s) (21n <0 

(stress) 

9s : 

2 In < 0.7 

(processing) 

94 ■ 

(64ri /jt)° 25 — O'* 

(processing) 


P (do) £ P — [d« m «'n> d imax ] C 3? 

where K and n are material constants for the flow stress-strain equation. 


and 


K = (E/l 3 ) 


12(x x + # 2 ) 

-6(x, 

- X 2 )l 

— 12x2 

6x 2 l 



+ * 2 ) 

—6x 2 l 

2x 2 P 




12X2 

— 6x 2 / 

symm 




4 X 2 I 2 


and 


F = (0, 0,p, 0)^ 


Variables: (x- l ,X 2 ,u i ,U 2 ,U 3 ,U 4 )' J 


p 


I 

X, 

Xi 1 

f 

<s> 

0 <s 

rft > 

1 


> V 



1 




Figure 6 
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Proposed Numerical Procedure 

Note that in this 10 formulation, the standard design problem has been imbedded in a 
family of programs, parametrized by the scalar input parameter d,, the initial stock diame- 
ter. For a fixed input (leading to a standard NLP), the problem can be solved by a gener- 
alized reduced gradient algorithm to get: 

Design Variables x\ = 30.89, x 7 = 11.17 
for Input d,= 3.5 leading to e* = 0.434 

Solving the problem again for different values of input, a trend is obtained as shown in 
the figure below. This should give an indication of the 10 solution strategy where we need 
to track the solution continuously as the input varies and to see if any critical or unstable 
points lead to bifurcation of the Kuhn-Tucker curve. Given an initial input po for a feasible 
program, a rough outline of a numerical procedure to accomplish this can be presented as 
follows: 

Step 1 From the solution of the 10 problem at po, obtain a descent direction Sp in the p 
space for the problem. 

Step 2 Using this direction, obtain a step size t in the p space. 

Step 3 Using p = Po + tdp, t E (0,f ], formulate the equations of appropriate first order 
necessary conditions (such as Fritz-John) in the reduced, scalar parameter space of t. 
Apply a continuation method for this locally parametrized process to identify the nature 
of critical points along this curve in the reduced t space. 

Step 4 At a bifurcation point, identify the type of singularity, and continue if a minimum 
persists along a branch. 

Note that in effect, we have here a combination of a descent and a continuation method (ref. 

1 and ref. 12). It remains to be seen if the conjectured prevalence of singular critical points 
in practical 10 problems justifies what appears to be a costly computational procedure. (Fig. 7.) 

DESIGN OBJECTIVE v/t A PROCESSING VARIABLE 



Ini dal bar stock diameter 


Figure 7 
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Conclusions 


The theory of optimality conditions of extremal problems can be extended to problems 
continuously deformed by an input vector. The connection between the sensitivity, well- 
posedness, stability and approximation of optimization problems is steadily emerging. We 
believe that the important realization here is that the underlying basis of all such work is 
still the study of point-to-set maps and of small perturbations, yet what has been identi- 
fied previously as being just related to solution procedures is now being extended to study 
modeling itself in its own right. 

Many important studies related to the theoretical issues of parametric programming and 
large deformation in nonlinear programming have been reported in the last few years, and 
the challenge now seems to be in devising effective computational tools for solving these 
generalized design optimization models. 
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